
EXTERNAL STORAGE AND DATA RECOVERY METHOD 
FOR EXTERNAL STORAGE AS WELL AS PROGRAM 

CROSS-REFERENCES TO RELATED APPLICATION 
The application relates to and claims priority from 
Japanese Patent Application No. 2003-76865^f iled on March 20, 
2003, the entire disclosure of which is incorporated herein 
by reference. 

BACKGROUND OF THE INVENTION 
rim/i ,i hi g ss E 5 5Z5grig n 

The present invention relates to , for example , an external 
storage jsuch as a disk device jand a data recovery method for 
the external storage ^as well as a program^. 
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In a business application program (database systemj^^ 
handling a relatively large amount of data, data is saved in 
a disk array apparatus which is formed separately from a host 
computer. Then , a database system of the host computer accesses 
data on the disk array apparatus to perform various data 
operations. The disk array apparatus is constituted by 
arranging plural disk devices injarray and is adapted to operate 
according to a writing instruction, a reading instruction, or 
the like from the host computer. 

Here , in the case in which a failure occurs during operation 

JU^ > 4 

of the database system due to, for example, an unexpected^ 
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power {$tm, ^ij^operation mistafe by an operator, a malfunction 
of a hardware circuit or other programs, there is a need to 
recover^contents of jfdatabase to a statej before the occurrence 
of the failure. In addition, other than the case of a failure, 
an operator may wish to date back a data operation to a desired 



pointy 

As a first conventional technique , in an ordinary database 

system, the database system itself on a host computer writes 

journal data (log data) to a predetermined disk device of a 

disk array apparatus separately fromjactual data. Therefore, 

in the ordinary database system, the database system itself 

reads out the journal data from the disk device on the basis 

of backup data, which has been acquired in advance, and Jc^ 

A 

sequentially reflects the journal data on the backup data. 
Consequently, the database system on the host computer can 
restoreidatabase to a desired pointito the extent that the journal 
data remains . 

In a second conventional technique ,j contents of a first 
disk device are saved in a disk device for backup at a 
predetermined period x and, at the same time, journal data is 
saved in a disk device forj journal. In the case in which a 
failure occurs in the first disk device, a virtual first disk 
device is generated in a second disk device on the basis of ( 
backup data and the journal data, and data access to the first 
disk device is internally switched to the virtual first disk 
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device. T ^ n ' when recover Y of the first disk device is 
completed, j contents of the virtual first disk device are 
transferred to the first disk device (e.g. , see JP-A-6- 110618 ) . 

In the first conventional technique, the database system 
itself on the host computer manages the journal data and is 
capable of restoring data to an arbitrary point . However, since 
the database system itself performs a data restoration operation, 
computer resources (an arithmetic operation unit, a memory, 
etc. ) of the host computer are used^or data restoration 
processing , which results in a decrease ^processing efficiency 
of ^original processing and other business processing during 
the restoration work . In addition , although the database system 
performs management of the journal d ^ a# if a stora 9 e disk for 
the journal data is fully occupied ,jpdata cannot be restored 
unless backup data is secured. Therefore, the database system 
is required to even perform capacity management or the like 
for the disk for journal data, which leads to an increase in 
K jprocessing load. Moreover, in the case in which generation 
management of data is performed, since backup data for plural 
generations is created, the processing burden is further 
increased. 

In the second conventional technique, If data restoration 
work can be performed without suspending^ processing^ which is 
being executed^ by switching the access to the virtual disk 
device. However, data can be recovered only to an immediately 
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preceding state, and the operator cannot restore the data to 
a desired arbitrary point. 

SUMMARY OF THE INVENTION 

The present invention has been devised in view of the 
above-mentioned problems, and it is an object of the present 
invention to provide an external storage and a data recovery 
method for the external storage^ as well as a program which can 
restore data to an ^rbitrary point without increasing & 
processing burden on #jhost computer side. Other objects of 
the present invention will, be obvious from descriptions 'of^ 
embodiments to be | montionod later. 

In order to solve the above-mentioned problems, an 
external storage in accordance with a f ir s tj[Vih^wpWi»fe of the 
present invention is i n nrt rr n nl Tt nr ngp Hri connected to 
a host computer, which ^includes : storing means which stores 
data to be used by the host computer; and control means which 
controls the storing means. The control means includes: 
registering means which registers a recoverable point to be 
set by the host computer concerning data stored in the storing 
means; information for selection sending means which sends 
information for selection at the registered recoverable point 
to the host computer in response to a request from the host 
computer; and recovering means which recovers data designated 
by the host computer to a designated recoverable point on the 
basis of the information for selection at the recoverable point . 
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As the storing means, for example, a storage constituted 
by arranging plural disk devices inj^array can be used. The 
host computer can set a recoverable point concerning data to 
be stored in the storing means. The recoverable point is ^ ' 
information indicating a point to which the data can be recovered 
and is also referred to as a restoration point . The recoverable 
point , which is set by the host computer regularly or irregularly^ 
is registered by the registering means. 

In the case in which restoration of data is required due 
to^occurrence of a failure or the like , the host computer requests 
the information for selection at the recoverable point from 
the control means . In response to this request , the information 
for selection sending means sends the information for selection 
to the host computer. The information for selection is 
information for selecting a recoverable point and can be 
displayed, for example, in a list format. 

The host computer selects a point to which the data is 
desired to be recovered on the basis of the received information 
for selection. The r ec overable point selected by the host 
computer is notified to the recovering means. Then, the 
recovering means recovers the data designated by the host 
computer to the designated point. The recovering means can 
restore the data by, for example, sequentially reflecting 
journal data up to the designated recovery point on backup data. 
Consequently, the data can be recovered to an arbitrary point 
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in the external storage without practically using computer 
resources of the host computer. 

The registering means is capable of registering arbitrary 
plural points, which are set by the host computer, as the 
recoverable point. In other words, the registering means can 
register not only an immediately preceding latest state but 
also arbitrary plural points. For example, the host computer 
can set a recoverable point automatically or according to a 
manual operation by an operator every time update processing 
(commitment) is requested or every time a data operation is 
finished. 

In an aspect of the present invention, the storing means 



has journal data storing means which acquires tas ctoa e journal 
data^, and the registering means associates mark information 
with a predetermined position of the journal data on the basis 
of an instruction from the host computer to thereby register 
the recoverable point . In other words , the journal data storing 
means in the external storage independently collects and stores 
the journal data automatically. Then, the registering means 
associates the mark information with the predetermined position 
of the journal data on the basis offsetting from the host computer 
to thereby register the recoverable point . The mark information 
can be included in the journal data or^can be managed as data 
separate from the journal data, and both the data can be 
associated with a unique identification code or the like. 
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In an aspect of the present invention, the journal data 
includes at least writing data , a writing position , and recovery 
flag information serving as the mark information. The 
registering means sets predetermined recovery flag information 
in the journal data to thereby register the recoverable point. 

A data structure of the journal data is extended by adding 
a recovery flag. A data area for setting a recovery flag is 
included in all journal data in advance. In the case in which 
a recoverable point is set for certain data, a recovery flag 
corresponding to the data is set . If the recovery flag is reset , 
the set recoverable point can be cancelled. 

Moreover, in an aspect of the present invention, the 

storing means has backup data storing means which stores backup 

data, and the control means has journal data managing means. 

ft 

Further, in the case in which a^free space of the journal data 
storing means haj^become insufficient , the journal datamanaging 
means transf ers^oldest journal data stored in the journal data 
storing means to the backup data storing means to increase the 
free space of the ^Jirnal data storing means and notifies the 
host computer that aa^oldest recoverable point among registered 
recoverable points has been changed. 

Recovery of data is realized by, for example, sequentially 
reflecting journal data up to a target point on backup data 
at a certain point (a roll forward system) . Therefore, in the 
case in which the journal data does not exist, data can be dated 
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back only to a point when it was backed up. On the other hand, 
the journal data is an aggregate of data update histories and 
increases day after day. When a ^cwinc ft amount of fcfeeji journal 
data reaches Jfjstorage capacity of a disk device, journal data 
tefaan jthat cannot be stored. Thus, in the case ii^w hich 
tjfree space for the journal data has become insufficient ^oldest 
data is transferred to backup data by^a necessary amount out 
of journal data accumulated already to secure a free space. 
The necessary amount of data to be transferred may be a fixed 
value set in advance orj^may be changed dynamically according 
to ^fa^tors^such as ^accumulation speed of the journal data 
and ^storage capacity of the backup data storing means . Here, 
transferring the oldest journal data to the backup data means 
reflecting the oldest journal data on the backup data and then 
deleting the oldest journal data. Note that, as long as there 
is an unused storage area injystoring means, it is also possible 
to automatically extend a journal data storage area and, in 
the case in which the unused storage area has become insufficient , 
transfer the oldest journal data to the backup data. 

A data recovery method for an external storage in 
accordance with a second^ri owfi/vi nt of the present invention 
a jIa I h eeoogpgacg luirUrod of rccovoq?ing j(data of an external 
storage, which is connected to a host computer, ^-^b^ ^Kt^rnnl 
s^erragej which^includes : a registration step of registering 
a recoverable point which can be set to arbitrary plural points 
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by the host computer concerning stored data; a list transmission 
step of sending information for selection of the registered 
recoverable point to the host computer in response to a request 
from the host computer; and a recovery step of recovering data 
designated by the host computer to a designated recoverable 
point on the basis of the information for selection at the 
recoverable point . 

The registration step, the list transmission step, and 
the recovery step may be executed in this orde^o^may be executed 
in a different order, for example, in parallel. 



A program in accordance with a third lunula L of the 
present invention is a program for controlling an external 
storage connected to a host computer ,jthe external storage has 
storing means which stores data to be used by the host computer, 
and the program realizes , on a computer of the external storage , 
registering means which registers a recoverable point to be 
set to arbitrary plural points by the host computer concerning 
data stored in the storing means; information for selection 
sending means which sends information for selection at the 
registered recoverable point to the host computer in response 
to a request from the host computer; and recovering means which 
recovers data designated by the host computer to a designated 
recoverable point on the basis of the information for selection 
at the recoverable point . 

A program in accordance with a fourth ewpoart of the 
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present invention is a program for controlling a host computer 
using an external storage, and the program realizes, on the 
host computer, registration instructing means which instructs 
and causes the external storage to register a recoverable point 
which can be set at arbitrary plural points concerning data 
stored in the external storage; information for selection 
requesting means which requests information for selection at 
the recoverable point registered in the external storage; and 
recovery instructing means which instructs the external storage 
to recover desired data to a desired recoverable point on the 
basis of the information for selection received from the external 
storage. 

This program can be provided, for example, in a form such 
as an API (Application Program Interface) and can be used 
preferably from various business application programs. 

For example, the program in accordance with the present 
invention can be fixed in various storage media^such as a disk 
t^pe storage medium and a semiconductor memory^ and placed on 
^market^orj^can be distributed from a server via a communication 
network. 

BRIEF DESCRIPTION Of THE DRAWINGS 
Fig . 1 is a a-i, ligmti^TQ diagram of an external storage system 



in accordance with a first embodiment of the present invention. 

Fig. 2 is a block diagram showing an outline of the storage 
system shown in Fig. 1. 
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Fig. 3 is a data diagram showing ^structure of journal 
data and writing control information. 

Fig. 4 is a block diagram showing program structures of 
a host computer and a disk control apparatus. 

Fig. 5 is a flowchart showing writing control processing. 

Fig. 6 is a flowchart showing journal disk management 
processing. 

Fig. 7 is a flowchart showing data recovery control 
processing in the case in which a recovery opportunity is 
notified from the host computer. 

Fig. 8 is a flowchart showing data recovery control 
processing in the case in which transmission of a recovery 
opportunity list is requested from the host computer. 

Fig. 9 is a flowchart showing data recovery processing 
in the case in which recovery is instructed from the host 
computer. 

Fig. 10 is a nrhnmnfi e diagram Sij^the case in which data 
management is performed in plural generations. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Embodiments of the present invention will be hcrarcrmaf tcr 
described j^on the basis of Figs. 1 to 10. 

First of all, an overall outline^f an external storage 
system will be described"^ ffiT^^ of Fig. 1. 

F i rct d an overall s Lj_ uu Luxe u£ the ayatcirrwil - 1 be describe d 
<on— tl±e baiLili, tjU-^Fiy V l . A storage system 60 includes a storage 
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device crontgoj. a^^r at j^^L O andystorage devices 30 . The storage 
device eontrol apparatuc j|10 performs control with respect to 
the storage devices 30 in accordance with commands received 
from information processing apparatuses 20 . For example, upon 
receiving data input/output requests from the information 
processing apparatuses 20 , the storage device control apparatus 
10 performs input/output processing for data stored in the 
storage devices 30. A logical volume (Logical Unit) 
(hereinafter abbreviated as LU) is set on physical storage areas 
provided by disk drives included in the storage devices 30. 
The LU is a logical storage area, and data is s^^o^on this 
LU. In addition, the storage device i oa L lXTl an Tipiyttrey fe^s^lO also 
exchanges various commands for managing the storage system 60 
with the information processing apparatuses 20. 

The information processing apparatuses 20 are computer 
systems which include CPUs ( Central Processing Units ) , memories , 
and the like. The CPUs of the information processing 
apparatuses 20 ^xe^te^y arious programs, whereby various 
functions are ^ ro allied . The information processing 

apparatuses^^ for example, may be personal computers or work 
stations^ or j^may be mainframe computers. In Fig. 1, for 
convenience of explanation, fir s L to fifLh five information 
processing apparatuses are illustrated. In order to identify 
the respective information processing apparatuses 20, in Fig. 
1, consecutive numbers are affixed in snrh .ri mnnnrr^g^ 
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"information processing apparatus 1" , "information processing 
apparatus 2", and the like to indicate the first to the fifth 
information processing apparatuses 20. Channel control units 
11 and disk control units 14 , which aassldescribed later, are 
also distinguished by affixing consecutive numbers^in the same 
manner. 

The first to the third information processing apparatuses 
20 are connected to the storage device eo nt foo, appaa?afeu q^ 10 
via a LAN (Local Area Network) 40. The LAN 40 may be , for example, 
the Internet or a private network. Data communication between 
the first to the third information processing apparatuses 20 



and the storage device aoritrol apparatuo ^lO is performed via 
the LAN 40 in accordance with, for example, the TCP/IP 
(Transmission Control Protocol/Internet Protocol). A data 
access request according to file name designation (a data 
input/output request by a unit of file; hereinafter referred 
to as "file access request" ) is sent from the first to the third 
information processing apparatuses 20 to the storage system 
60. 

A backup device 71 is connected to the LAN 40. As the 
backup device 71, for example, a disk type storage device such 
as an MO (magneto-optic: magneto-optical storage), a CD-R 
(CD -Recordable: readable/writable compact disk) , or a DVD-RAM 
(Digital Versatile Disk- RAM: readable/writable DVD) or a tape 
type storage device such as a DAT ( Digital Audio Tape ) , a cassette 
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tape, an open tape, or a cartridge tape can be used. The backup 
device 71 performs communication with the storage device oontrol 
apva.LdLiu.^lO via the LAN 40 to thereby store backup data of 
the data stored in the storage devices 30. In addition, the 
backup device 71 can also be constituted so as to be connected 
to the first information processing apparatus 20 . In this case , 
the backup device 71 is adapted to acquire backup data of the 
data stored in the storage devices 30 via the first information 
processing apparatus 20. 

The storage device o ontrol apparatuc ^ 10 performs 
communication with the first to the third information processing 
apparatuses 20 and the backup device 71 via the LAN 40 through \ 
first to the fourth channel control units 11. The first to 
the fourth channel control units 11 receive^ file access requests 
from the first to the third information processing apparatuses 
20 individually. In other words, network addresses (e.g., IP 
addresses) on the LAN 40 are allocated to the first to the fourth 
channel control units 11, respectively, and the first to the 
fourth channel control units 11 are adapted to behave as NASs 
(Network Attached Storages), respectively. The first to the 
fourth channel control units 11 are capable of providing the 
first to the third information processing apparatuses 20 with 
services as NASs as if the first to the fourth channel control 
units 11 are independent NASs, respectively. The first to the. 
fourth channel control units 11 may bo brrr i naf trr^rilibiuuijiuLuQ 
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as CHNs. In this way, one storage system 60 is constituted 
so as to include the first to the fourth channel control units 
11, which provide services as NASs , respectively, whereby NAS 
servers , which have been operated individually by independent 
computers conventionally, are integrated in the one storage 
system 60. Tlimi, Consequently, a coraprehensi^operation of 
the storage system 60 becomes possible, and ^efficiency of 
maintenance work^such as various settings/controls, failure 
management, and version maintenance can be realized. 

Note that the first to the ^^^^|^ Lannel contro1 units 
11 of the storage device control apparat t js ^ 10 are realized by, 
for example, hardware formed on a circuit substrate, which is 
integrally constituted as a unit , an OS (Operating System) which 
is executed by this hardware , and sof tware^such as an application 
program^ which runs on this OS. In the storage device system 
60 , functions | which have been implemented as a part of hardware 
conventionally! ^realized by the software. Therefore, by 
using the storage system 60, a system operation with a lot of 
flexibility becomes possible, and it becomes possible to 
meticulously cope with user needs which are diverse and change 
rapidly. 

The third and the fourth information processing 
apparatuses 20 are connected to the storage device control 
apparatus ^10 via an SAN (Storage Area Network) 50. The SAN 
50 is a network for exchanging data with the third and the fourth 
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information processing apparatuses 20^**ttft a^block, which is 



a management unit of data in storage areas provided by the storage 
devices 30, as a unit. Communication between the third and 
the fourth information processing apparatuses 20 and the storage 
device e ontgol unit j[ 10 , which is performed via the SAN 50, 
generally complies with fiber channel protocol. A data access 
request by a unit ofjblock (hereinafter referred to as a block 
access request ) is sent from the third and the fourth information 
processing apparatuses 20 to the storage system 60 in accordance 
with the fiber channel protocol. 

Ajf SAN- compatible backup device 70 is connected to the 
SAN 50. The SAN-compatible backup device 70u performs 
communication with the storage device oontrol apparatus} 10 via 



the SAN 50 to thereby store backup datajpf -fete data stored in 
the storage devices 30. 

The storage device control apparatus 10 performs 
communication between the third and the fourth information 
processing apparatuses 20 and the SAN-capable backup device 
70 via the SAN 50 using the fifth and the sixth channel control 
units 11. The fifth and the sixth channel control units 11 
moy he hereinaf t er ^ateLu, u u 1 J L B Q as CHFs . 

In addition, the fifth information processing apparatus 
20 is directly connected to the storage deviceteoftteoJ appnratuij 
10 without the intervention of the network such as the LAN 40 
or the SAN 50. The fifth information processing apparatus 20 
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may be a mainframe computer^ but , naturally ,^is not limited to 
this. Communication between the fifth information processing 
apparatus 20 and the storage device control apparatus 10 complies 
with communication protocols, for example, FICON (Fibre 
Connection) (registered trademark) # ESCON (Enterprise System 
Connection) (registered trademark), ACONARC (Advanced 
Connection Architecture) ( registered trademark) , FIBARC (Fibre 
Connection Architecture) (registered trademark) , and the like. 
A block access request is sent from the fifth information 
processing apparatus 20 to the storage system 60 in accordance 
with these communication protocols. , 



The storage device control apparatus ^ 10 performs 
communication with the fifth information processing apparatus 
20 through the seventh and the eighth channel control units 
11. The seventh and the eighth channel control units 
ter hereinafterjyatf.ii wldUM as CHAs . 

Another storage system 61, which is installed in a site 

( secondary site ) remote from an installation site of the storage 

system 60 (primary site) , is connected to the SAN 50. a Another 

<JH A 
storage system 61 is used ^ao ani apparatus - which io a data copying 

destination in a^jfunction of replication or remote copying. 

Note that arrothor ^ storage system 61 may be connected to the 

storage system 60 via a communication line^ such as fefaeyyATM 



• than it! 



(Asynchronous Transfer Mode )^ other than ^t he SAN 50. In this 
case, the channel control unit 11 including an interface for 
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using the communication line (channel extender) is adopted. 



described. The storage devices 30 include a large number of 
disk drives (physical disks) and provide the information 
processing apparatus 20 with a storage area. Data is stored 
in an LU serving as a logical storage area. As the disk drive, 
various devices such as a hard disk device, a flexible disk 
device, and a semiconductor storage can be used. Note that, 
for example, the storage devices 30 may be adapted to constitute 
a disk array with plural disk drives . In this case, the storage 
devices 30 can provide the information processing apparatuses 
20 with storage areas with plural disk drives which are managed 



by RAID (Redundant Array of Independent (Inexpensive) Disks )^. 

The storage device control apparatus 10 and the storage 
devices 30 may be directly connected as shown in Fig. ljor^may 
be indirectly connected via a network. Moreover, the storage 
device 30 can also be constituted as a device integral with 



the storage device control apparatuc ^ 10 . 

As the LU which is set in the storage devices 30, there 
are a user LU accessible from the information processing 
apparatus 20 , a system LU which is used for control of the channel 
control units 11, and the like. An OS, which is executed in 
the CHNs ll^is also stored in the system LU. In addition, the 
respective channel control units 11 are associated with the 
respective LU in advance. Consequently, an accessible LU is 




Next, structure of the storage devices 30 will be 
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allocated to each of the channel control units 11 . In addition , 
the association can also be set such that one LU is shared by 
the plural channel control units 11 . Note that , in the following 
description, the user LU may be described as a user disk and 
the system LU may be described as a system disk. In addition, 
the LU shared by the plural channel control units 11 may be 
described as a shared LU or a shared disk. h 

Next, ((^structure of the storage device, eontrol apparatuo 
10 will be described. The storage device j(o ontrol apparatuc 

10 includes the channel control units 11, a shared memory 12, 
a cache memory 13, the disk control units 14, a connection unit 
15, and a management terminal 16. 

The channel control units 11 have a communication 
interface for performing communication with the information 
processing apparatuses 20 and are provided with a function for 
exchanging a data input /output command or the like with the 
information processing apparatuses 20. For example, the CHNs 

11 receive file access requests from the first to the third 
information processing apparatuses 20. Consequently, the 
storage system 60 can provide the first to the third information 
processing apparatuses 20 with services as NASs. In addition, 
the CHFs 11 receive block access requests complying with the 
fiber channel protocol from the third and the fourth information 
processing apparatuses 20. Consequently, the storage system 
60 can provide the third and the fourth information processing 
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apparatuses 20 with data storage services which are accessible 
at high speed. In addition, the CHAs 11 receive a block access 
request complying with a protocol such as FICON , ESCON , ACONARC , 
or FIBARC from the fifth information processing apparatus 20. 
Consequently, the storage system 60 can also provide a mainframe 
computer or the like^such as the fifth information processing 
apparatus 20^ with the data storage service. 

The respective channel control units 11 are connected 
to the management terminal 16 by an internal LAN 17. 
Consequently, it also becomes possible to send a program or 
the like to be executed by the channel control units 11 from 
the management terminal 16 to the channel control units 11 and 
cause the channel control units 11 to install the program. & 
structure of the channel control units 11 will be described 
later. 

The connection unit 15 connects the respective channel 
control units 11, the shared memory 12, the cache memory 13, 
and the respective disk control units 14jeach other. Exchange 
of data and commands among the channel control units 11, the 
shared memory 12, the cache memory 13, and the disk control 
units 14 is performed via the connection unit 15 . The connection 
unit 15 is constituted by, for example, a high-speed bus such' 
as an ultra-high speed cross ]<teEE3fl| switch which performs data 



transfer according to high-speed switching. Since the channel 
control units 11 are connected by the high-speed bus. 
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^communication performance among the channel control units 11 
is improved compared with the case in which NAS servers operating 
on individual computers are connected via a LAN . In addition, 
consequently , ^high-speed file sharing function, high-speed 
fail-over, and the like become possible. 

The shared memory 12 and the cache memory 13 are storage 
memories which are shared by the respective channel control 
units 11 and the respective disk control units 14. The shared 
memory 12 is mainly used for storing control information, 
commands, and the like. The cache memory 13 is mainly used 
for storing data. 

For example, in the case in which a data input/output 
command, which a certain channel control unit 1 ^received from 
the information processing apparatus 20, is a writing command, 
the channel control unit 11 writes the writing command in the 
shared memory 12 and, at the same time, writes writing data 
received from the information processing apparatus 20 in the 
cache memory 13. On the other hand, the disk control units 
14 monitor the shared memory 12. When it is detected that the 
writing command is written in the shared memory 12, the disk 
control units 14 read|| out the writing data from the cache memory 
13 in accordance with the command and writejf the read-out data 
in the storage devices 30. 

The disk control units 14 perform control of the storage 
dijwwiuc devices 30. For example, as described above, the disk 
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control units 14 perform writing of data in the storage devices 
30 in accordance with the writing command which the channel 
control units 11 ^received from the information processing 
apparatuses 20. In addition, the disk control units 14 change 
a data access request to the LU according toklogical address 
designation sent from the channel control units 11 into a data 
access request to a physical disk according tojphysical address 
designation. In the case in which the physical disks in the 




storage devices 30 are managed by tsfee RAII^, thfe 1 disk control 
units 14 perform access to data in accordance with a RAID 
constitution. In addition, the disk control units 14 also 
perform control of copying management and backup control of 
data stored in the storage devices 30. Moreover, the disk 
control units 14 also perform control for storing a copy of 
data of the storage system 60 in the primary site in another 
storage system 61 which is installed in a secondary site (called 
a replication function or a remote copy function) and the like 
with an object of prevention of data loss (recovery from a 
disaster) and the like at the time of occurrence of a disaster. 

The respective disk control units 14 are connected to 
the management terminal 16 via the internal LAN 17 and are capable 
SE^ommunicating with the management terminal 16 oacfr otihar. 
Consequently, it is wadf possible to send a program or the like, 
which the disk control units 14 are caused to execute, from 
the management terminal 16 to the disk control units 14 and 
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cause it to install the program or the like. 

Next, the management terminal 16 will be described. The 

management terminal 16 is a computer for maintaining andmanaging 

the storage system 60. By operating the management terminal 

16 , ^settinc^of a physical constitution in the storage 

devices 30,Jsetting of an LU, ^installation of a program to be 

executed by the channel control units 11, and the like can be 

performed. Here, examples of the setting of a physical disk 

constitution in the storage deyices 30 include addition or 

reduction of physical disks andjchange of a RAID constitution 

(change from RAID 1 to RAID 5, etc.). Moreover, from the 

management terminal 16 , work such as confirmation of an operation 

state of the storage system 60 , specif ication of a failed portion , 

and installation of an OS to be executed by the channel control 

units 11 can also be performed. In addition, the management 

terminal 16 is connected to an outside maintenance center by 

a LAN, a telephone line, or the like and is also capable of 

performing failure monitoring in the storage system 60 using 

the management terminal 16\and, if a failure occurs ^promptly i 

coping with the failure. Occurrence of a failure is miLlllgd^ 

from, for example, an OS, an application program, driver software , 

or the like . This notification can be performed b^, for example , *L~ 

/ T 
the HTTP (HyperText Transfer Protocol) , the SNMP ( Simple Network 

Management Protocol), an electronic mail, or the like. »BSe ^ 

setting and control can be performed by an operator or the like 
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operating the management terminal 16 with a web page provided 
by a web server running on the management terminal 16 as a user 
interface. The operator or the like operates the management 
terminal 16 to , for example , set an object and contents of failure 
monitoring and set a failure- notification destination. 

The management terminal 16 may be incorporated in the 
storage device control apparatfi^ lO>or>may be externally attached 
to the storage device control apparatus 10 . In addition, the 
management terminal 16 may be constituted as a computer which 
exclusively performs maintenance and management of the storaae 
device oontrol eipp aii i L u L, K 10 and the storage device 30^or A may 
be constituted by giving maintenance and management functions 
to a general purpose computer. 

Next, an example of the data recovery method according 
to the present invention will be described with reference to 

Fig. 2. Fig. 2 is a «±[ uLii; diagram of a main part extracted 

from the storage system doooried ^with reference to Fig. 1 . The 
external storage system shown in Fig. 2 is roughly divided into 
a host computer 10 and an external storage «s A described later| 
s p ge L d ^w^ry . The external storage is roughly divided into 
a disk control apparatus 200 and a mass storage 400. Here 
^^correspondence ralaLit» n between Fig. 1 and Fig. 2 will be 
briefly described. The storage system 60, the channel control 
units 11, the shared memory 12 and the cache memory 13, the 
connection unit 15, the disk control units 14, the storage 
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devices 30, and the information processing apparatuses 20 in 
Fig. 1 correspond to the disk control apparatus 200, a channel 
port 210 and a microprocessor 220, a buffer memory 230, a bus, 
switches, and the like (not shown), the microprocessor 220, 
a storage 400 , and the host computer 100 in Fig . 2 , respectively . 
The microprocessor 220 may exist either on the channel control 
units 11 side or the disk control units 14 side. 

The host computer 100 is constituted by, for example. 



an application program 110 (hereinafter rthh r r v i nf e r r i as 
^application) handling a database. In addition, although not 
illustrated, the host computer 100 includes a user interface 
for exchanging information with an operator through , for example , 
a pointing device, a keyboard a*ffitoh , a monitor display, or 
the like. The application 110 accesses data in the storage 
400 via the disk control apparatus 200 to thereby process a 
predetermined j ob . 

The disk control apparatus 200 controls the storage 400 
and includes the channel port 210, the microprocessor 220 , and 
the buffer memory 230. 

The microprocessor 220 performs two-way data 
communication with the host computer 100 via the channel port 
210. The microprocessor 220 executes a disk control program 
300. Writing control processing 310, writing data processing 
320, disk management processing 330, the data recovery control 



a personal computer, a work station, or the like 
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processing 340 , the data recovery processing 350, and the data 
synchronization processing 360 are included in the disk control 
program 300. 

Details of the main processing will be described later. 
The writing control processing 310 mainly manages writing 
control information (journal control information) at the time 
of data writing. The writing data processing 320 performs data 
writing in a predetermined disk device. The disk management 
processing 330 mainly performs management of a journal data 
storage disk 430. The data recovery control processing 340 
registers recovery opportunities set from the host computer 
100 and sends list data of the registered recovery opportunities 
to the host computer 100. The data recovery processing 350 
recovers data of a designated disk device to a designated point . 
The data synchronization processing 360 performs backup 
processing of data according to an instruction from the host 
computer 100 . 

For example, recovery data information D10, journal data 
D20, writing control information D30, and update data D40 are 
stored in the buffer memory 230 . The recovery data information 
D10 is information j^a history of recovery processing 
(restoration processing) of data and records, for example, a 
data recovery destination , a recovery point , and the like . The 
journal data D20 is an update history of a data operation and 
is sequentially transferred from the buffer memory 230 to the 
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journal storage disk 430. The writing control information D30 
includes information necessary for recovering data at an 
arbitrary point. The update data D40 is data for which^update 
is instructed by the application 110 and is transferred from 
the buffer memory 230 to a data storage disk 410. Note that 
the data described above flo no4 need tojexist on the buffer 
memory 230 at the same time. In addition, although the buffer 
memory 230 is shown as if it is a single memory for convenience 
of explanation, for example, the buffer memory 230 may be 
constituted as an aggregate of plural types of memory devices. 

The mass storage 400 includes the data storage disk 410, 
a backup data storage disk 420, and the journal data storage 
disk 430. Latest data (actual data) , which is current lyjjused, 
is stored in the data storage disk 410 . Backup data at a certain 
point is stored in the backup data storage disk 420. Journal 
data is stored in the journal data storage disk 430. Note that 
the respective disks 410 to 430 are accurately disk devices 
and include plural disks. A data storage disk, a backup data 
storage disk, and a journal data storage disk are hereinafter 
referred to as a data disk, a backup disk, and a journal disk, 
respectively. ^^fc J, 

Fig. 3 is a data structure diagram ^showing n nrhrrmiiti^ 
^structure of the journal data D20 and the writing control 
information D30 . 

The journal data D20 according to this embodiment includes 
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the writing control information D30 and the update data (writing 
data) D4 0. The writing control information D30 carries out 
a function as journal control information and includes 
information such as a data writing position D31, a data size 
D32, a time stamp D33, a recovery flag D34, and other control 
information D35. The data writing position D31 is positional 
information indicating where in which disk device data is written . 
The data size D32 is information indicating ft^size of written 
data. The time stamp D33 is information indicating ^jfdata 
writing time. The recovery flag D3^T~1S^ mark information 
indicating Sfessfe a point ^ya recoverable time ( restoration point ) . 
When the recovery flag D34 is set, the restoration point is 
set as recoverable data. When the recovery flag D34 is reset, 
the setting of the restoration point is cancelled. The other 
control information D35 includes other necessary information 
such as a control number for uniquely specifying the writing 
control information D30, a data type, and the like. 

ik 

In this embodiment, as shown in Fig. 3, ^restructure of 
the journal data D20 is independently extended, and the recovery 
flag D34 is provided in the journal data D20. Consequently, 
an arbitrary point can be set freely as a recoverable point 
simply by adding a small amount of data , and data can be recovered 
to an arbitrary point. However, the structure of the journal 
data D20 and the recovery flag D34 is not limited to this, and 
the journal data D20 and the recovery flag D34 may be separated 
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and associated by a unique ID ( identification code ) or the like . 

Wftact | Fig. 4 is a block diagram showing an outline of 
program structures of the host computer 100 and the disk control 
apparatus 200. 

The application 110 performs two-way data communication 
with the disk control program 300 via the OS 120 of the host 
computer 100. The OS 120 includes an API (Application Program 
Interface) group 130. An API for data writing 131, an API for 
recovery opportunity notification 132, an API for recovery 
opportunity list acquisition request 133 , and an API for recovery 
instruction 134 are included in the API group 130. By calling 
and using these APIs 131 to 134 appropriately, the application 
110 can set a desired point as a recovery opportunity, read 
out a recovery opportunity list| which has already been set, 
and select a desired point to instruct recovery of data. 

An overall operation will be described briefly with 
reference to Fig. 4. When the application 110 instructs the 
disk control apparatus 200 to request^ data update (request 
commitment) via the API for data writing 131 (SI) , the writing 
control processing 310 of the disk control program 300 writes 
data in a predetermined disk via the writing data processing 
320 and notifies the application 110 that the update request 
has been processed (S2). 

The application 110 can set, for example, a desired point 
as a recovery opportunity (restoration point), which is a 
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recoverable point, regularly or irregularly during processing 
of a job. The application 110 calls the API for^ recovery 
opportunity notification 132 to thereby designate data, for 
which the recovery opportunity is set, with respect to the disl 




co nt rol device 200 (S3). When the recovery opportunity^ 
^nrit 1 ! Ti cd, the data recovery control processing 3 40 of the disk 



control program 300 sets a recovery flag of the designated data 
and notifies the application 110 that the recovery opportunity 
has been set (S4). 

In the case in which data is /recovered ^duo - to a factor 

m 

such as)occurrence of a failure, the application 110 calls the 
API f orjprecovery opportunity list acquisition request 133 and 
requests list information at the recoverable point from the 
disk control apparatus 200 (S5). When a list is requested, 
the data recovery control processing 340 inspects the journal 
disk 430 to acquire information on the data for which the recovery 
flag has been set and prepares a recovery opportunity list. 
The data recovery control processing 340 returns the recovery 
opportunity list to the application 110 (S6). 

The application 110 selects at least one point, to which 
recovery is desired, with reference to the recovery opportunity 
list stored in the memory 140. The application 110 calls the 
API for^recovery instruction 134 to thereby instruct the disk 
control apparatus 200 to recover data of a predetermined disk 
to the desired point (S8). When the recovery instruction is 
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received from the application 110 , the data recovery processing 
350 uses the backup disk 420 and the journal disk 430 to recover 
the designated data to the designated point. The recovery 
processing 350 notifies the application 110 that the recovery 
processing has been completed (S9). 

Next , detailed control of the respective portion will 
be described with reference to Figs. 5 to 9 . r - n i g r Fig. 5 
is a flowchart showing the writing control processing. Note 
that , as J# is true of the following description , the illustrated 
flowchart shows a main part of an operation for understanding 
of the invention, and it is possible that the flowchart is 
different from an actual program. In the figures, "step" is 
abbreviated as "S". 

When the application 110 sends a writing request, the 
dataD40 on the buff er memory 230 is updated (S21) and the writing 
control information D30 on the buffer memory 230 is also updated 
(S22). Next, the processing judges whether or not there is 
K sufficient free space in the journal disk 430 (S 2^Q . For 
example , this can be judged according to whe t^ r or not ^present 
free space of the journal disk 430 exceeds jfydata size of data 
which is about to be written. If the free space of the journal 
disk 430 is insufficient (S23: NO), the processing executes 
journal disk management processing to be described later with 
reference to Fig. 6 (S24) to secure the free space, and^if 
necessary, updates the writing control information on the buffer 
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memory 230 (S25) . The case in which it is necessary to update 
t|ie writing control ii^ormation is , for example, a case in which 
(Ajwriting position of jpournal data fluctuates due to journal 
automatic extension to be described later. 

If a sufficient free space exists in the journal disk 
430 (S23: YES) and if a sufficient free space is secured in 
the journal disk 430, the processing additionally writes the 
writing data D40 and the writing control information D30 (i.e. # 
the journal data D20) in the journal disk 430 (S26) . In addition, 
the processing writes the writing data D40 on the buffer memory 
230 in a predetermined position of the data disk 410 (S27) and 
notifies the host computer 100 (accurately, the application 
110 on the host computer 100; this is true of the following 
description^) that the data writing has been completed (S28). 

N °te j|hat S2 6 and S2 7 may be performed at^an opportunity 
separate fron^the writing control processing (asynchronously) . 
In that case, for example, the steps can be managed by providing 
a flag, which indicates whether or not the data is reflected 
on the disk, in the data on the buffer memory. 

Then, the processing judges whether or not a backup update 
flag is ON (S29). The backup update flag w^mark information 



which indicates that^ oldest journal data has been transferred 
to the backup disk 4 20 in order to secure a free space «£^the 
journal disk 430 . Since an oldest point recoverable from backup 
data is changed by the transfer of the journal data, if the 
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backup update flag is set in an ON state ( S29 : YES ) , the processing 
notifies the host computer 100 that the backup data has been 
updated (S30). After notifying the host computer 100 of the 
backup update, the processing resets the backup update flag 
to an OFF state (S31). 

ftHfcWfo Fig. 6 is a flowchart showing details of the journal 
disk management processing S24 in Fig. 5. First, the processing 
judges whether or not an automatic extension mode of the journal 
disk 430 is set (S41) . The automatic extension mode is a mode 
for searching an unused disk or an unused storage area to 
automatically increase ptj^logical size of the journal disk 430. 

If the automatic extension mode is not set (S41: NO) , 
the processing selects/oldest data among the journal data stored 
in the journal disk 4 30 and reflects the oldest data on the 
backup disk 420 (S42). The oldest journal data transferred 
to the backup disk 420 is deleted from the journal disk 430 

(543) . Consequently, the free space of the journal disk 430 
increases . The processing transfers journal data to the backup 
disk 420 in order from the oldest journal data until the free 
space of the journal disk 430 reaches a predetermined value 

(544) . If the free space of the journal disk 430 has reached 
the predetermined value (S44: YES), the processing sets the 
backup update flag to the ON state (S45). Consequently, as 
shown in S30 in Fig. 5, the backup data is updated, and i «* 
noH r i Hi3 — 4ru the host computer 100 Jthat an oldest point 
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recoverable from the backup data has been changed. Note that 
the predetermined value in S44 may be a fixed value set in advance 



according to fcjfree space of a backup disk, fa^size of data to 
be written in the data disk 410, or the like. 

On the other hand, if the automatic extension mode of 



an unused storage area (referred to as unused area) from disk 
devices connected to the journal disk 430 and judges whether 
or not an unused area capable of saving journal data exists 
(S46, S47). If an unused area has not been found (S47: NO) # 
the processing shifts to S42 and transfers the oldest journal 
data to the backup disk 420 as described above to thereby secure 
a free space in the journal disk 430. If an unused area has 
been found (S47: YES), in an attempt to use the found unused 
area as a journal disk, the processing extends a logical size 
of the journal disk 430 and, at the same time, updates a disk 
management map (S48). Then, the processing judges whether or 
not a free space generated by the extension of the logical size 
of the journal disk 430 has reached a predetermined value ( S49 ) , 
and automatically extends the unused area as a storage area 
for journal data until the free space of the journal disk 430 
reaches the predetermined value while repeating the processing 
of S46 to S49. 

ftfyMty Fig. 7 shows registration processing for a recovery 




the journal disk 430 is set (S41: YES) , the processing searches 
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opportunity instructed from the host computer 100 . As described 
above, in this embodiment, the host computer 100 can set plural 
opportunities in which an arbitrary point is recoverable 
(restoration point). 

When a recovery opportunity, which should be registered. 



is nTU LiriuQJ from the host computer 100 to the disk control 
apparatus 200 , the data recovery control processing 340 searches 
a position of latest data stored in the journal disk 430 (S51) j 
and sets a recovery flag in writing control information 
corresponding to latest writing data to an ON state to update 
the recovery flag (S52) . Then, the processing informs the host 
computer 100 that the setting of the recovery opportunity has 
been completed and, at the same time, notifies the host computer 
100 of a control number for specifying writing control 
information (S53). In this way, the application 110 of the 
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host computer 100 can instructj^setting of a recovery opportunity 
for data at an arbitrary point at the time of data writing. 

Fig. 8 shows transmission processing for a recovery 
opportunity list which returns list information of recovery 
opportunities in response to a request from the host computer 
100. First, the processing selects a disk corresponding to 
data, for which recovery is instructed from the host computer 
100 , in the journal disk 430 , and sets a pointer on oldest journal 
data in the selected disk (S61). 

Then, the processing reads journal data from the oldest 
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journal data (S62), checks whether or not a recovery flag in 
writing control information concerning the read journal data 
is set to an ON state (S63), and^if the recovery flag is set, 
adds the read journal data to the list information of recovery 
opportunities and records the journal data (S64) '. S62 to S64 
are repeated until final data stored in the disk selected in 
S61 is read out (S65) . In this way , the processing sequentially 
checks journal data corresponding to the designated data from 
the oldest data to the latest data and extracts journal data, 
for which a recovery flag is set, to generate a recovery 
opportunity list. The generated recovery opportunity list is 
sent to the host computer 100 together with a completion report 
or ^asynchronously (S66) . 

£|S£t%r Fig. 9 shows data recovery processing. The 
application program 110 on the host computer 100 can instruct 
recovery of data to a desired point on the basis of the list 
information of recovery opportunities acquired by the 
processing shown in Fig. 8. * 



When a recovery instruction is notlfiiLisa^f rom the host 
computer 100, the data recovery processing 350 selects disks 
corresponding to data, for which recovery is instructed, in 
the backup disk 420 and the journal disk 430, respectively ( S71 ) . 

Next, the processing judges whether or not a disk 
designated as a data recovery destination by the host computer 
100 is the backup disk 420 (S72). In other words, in this 
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embodiment, data up to a designated point can be recovered to 
disk devices other than the backup disk 420. In the case in 
which the disk device designated as a recovery destination is 
a disk device other than the backup disk 420, the processing 
copies the backup data, which is stored in the backup disk 420, 
to the designated disk device to complete preparation of backup 
data to base for data recovery (S73) . 

Next, the processing searches^ oldest journal data from 
the journal disk 430 (S74) , reads out data in order fromioldest 
journal data, and reflects the data on stored contents of the 
disk designated as the recovery destination (S75). The 
processing reads out journal data until data is recovered to 
the point designated by the host computer 100 and updates the 
stored contents of the recovery destination disk (S76). 

In the case in which data has been recovered to the 
designated point, the processing notifies the host computer 
100 that the data recovery has been completed^77 ) . In addition, 
the processing records inf ormation^such as ajjrecovery time and 
^recovery destination^ in the recovery data information D10 
(S78) 

According to this embodiment, since recovery of data is 
automatically performed in an external storage, computer 
resources of the host computer 100 are never consumed for data 
recovery processing, andjef f iciency of other job processing 
on the host computer 100 is never decreased. In particular. 
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in the application 110 using a mass external storage, since X 



lass external st 



large quantity of data is handled, *tj burden tffjthe data recovery 
processing increases, and a^arge amount of computer resources 
are consumed. Therefore , "^processing speed of other jobs 
performed on the host computer 100 decreases and, in addition, 
processing time until completion of data recovery increases. 
However, in this embodiment , only a small quantity of processing! 

) 

such as ^instruction for setting of recovery opportunities , ^ 
request for acquisition of a recovery opportunity list, and 
data recovery processing is executed by the host computer 100, 
and actual data^recovery processing is left to the external 
storage . Thus , ^burden on the host computer 100 can be reduced . 
While the recovery of data is performed in the external storage, 
the host computer 100 can process other jobs efficiently. 

In addition, since arbitrary plural points can be set 
as recovery opportunities and data is recoverable to a desired 
point, convenience is high unlike the conventional technique 
for simply recovering data to immediately preceding data. 

Moreover, in this embodiment, since the APIs 131 to 134 
for performing instruction for setting a recovery opportunity, 
request for acquisition of a recovery opportunity list, and 
the like from the host computer 100 side are prepared, a host 
computer becomes capable of using the external storage in 
accordance with the present invention simply by including these 
unique APIs. 
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In addition, in this embodiment, since journal data is 
automatically collected and management of a free space of the 
journal disk 430 is also performed in the external storage, 
the journal disk 430 can be prevented from being fully occupied 
to make data recovery impossible. 

Further, in this embodiment, since the data structure 
of the journal data D20 is extended and the recovery flag is 
set in the journal data D20 (in the writing control information 
D30 serving as journal control information), although this 
structure is relatively simple, data recovery to arbitrary 
plural points can be realized. 

Fig. 10 shows a second embodiment of the present invention . 
In this embodiment, data management of plural generations is 
performed. In other words, in addition to the data disk 410 
maintaining latest data, data can be managed in plural 

iy 

generations in such a way asj the one generation precedent data 
disk 410 (1GA) storing ^ data preceding by one generation and 



the two generations precedent data disk 410 ( 2GA ) s toring data 
preceding by two generations. 

For example, after res toringJ| recorded contents of 

the backup^isk 420 to the one generation precedent data disk 
410 (1GA), ^journal data of data dB stored in the journal disk 
430 is read out and reflected on the one generation precedent 
data disk 410 ( 1GA) , data can be dated back to data preceding 
by one generation. Similarly, by copying backup data in the 
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two generations precedent data disk 410 (2GA) and then reflecting 
journal data of data dB and data dC thereon, data can be dated 
back to data preceding by two generations. In this way, even 
in the case in which data is managed in plural generations , 
in accordance with the present invention, data of plural 
generations can be established and managed in the external 
storage without imposing a processing burden on the host computer 
100. 

Note that the present invention is not limited to the 
above-mentioned embodiments. Those skilled in the art can 
perform various additions, alterations, and the like within 
the scope of the present invention. 
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